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Abstract  :  Outer  linearisation  methods,  such  as  Van  Slyke  and  Wets’s  L-shaped  method  for  stochastic 
linear  programs,  generally  apply  a  single  cut  on  the  nonlinear  objective  at  each  major  iteration.  The  structure 
of  stochastic  programs  allows  for  several  cuts  to  be  placed  at  once.  This  paper  describes  a  multicut  algorithm 
to  carry  out  this  procedure.  It  presents  experimental  and  theoretical  justification  for  reductions  in  major 
iterations.  (  ,  A.  '• 1  • .  *,  •  J 
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1.  Introduction 


Two-stage  stochastic  linear  programs  have  a  deterministic  equivalent  program  with  convex  objective 
function  that  can  be  solved  by  a  variety  of  methods.  The  L-shaped  method  of  Van  Slyke  and  Wets  [12]  is 
a  cutting  plane  or  outer  linearisation  technique  for  solving  this  program  when  the  random  variables  have 
finite  support.  It  has  been  extended  to  multi-stage  stochastic  linear  and  quadratic  programs  by  Birge  [3] 
and  Louveaux  [10],  respectively.  Their  analyses  showed  the  L-shaped  algorithm  to  be  an  effective  solution 
technique  for  a  variety  of  examples.  The  structure  of  stochastic  programs,  however,  allows  the  L-shaped 
method  to  be  extended  to  include  multiple  cuts  on  the  objective  in  each  major  iteration.  This  paper 
describes  this  procedure  for  two-stage  stochastic  linear  programs.  A  multi-stage  version  has  been  proposed 
by  Silverman  [11]. 

Adding  multiple  cuts  at  each  iteration  of  an  outer  linearisation  procedure  corresponds  in  the  dual  to 
including  several  columns  in  the  master  problem  of  an  inner  linearisation  algorithm  such  as  Dantzig- Wolfe 
decomposition  (see,  for  example,  Lasdon  [9]).  In  inner  linearisation,  adding  several  columns  instead  of  a  single 
aggregated  column  may  speed  up  convergence  (see  Birge  [2])  and  reduce  the  number  of  major  iterations.  The 
same  types  of  behavior  may  arise  in  outer  linearis  at  ion,  but  only  qualitative  descriptions  have  been  given.  In 
this  paper,  we  quantify  this  phenomenon  by  using  the  problem  structure  to  derive  worst-case  bounds  on  the 
number  of  major  iterations  in  the  single  and  multiple  cut  cases.  These  results  are  supported  by  experiments 
on  practical  test  problems. 

In  Section  2,  we  briefly  describe  the  L-shaped  algorithm  and  the  problem  structure.  In  Section  3,  we 
present  the  multicut  algorithm  and,  in  Section  4,  we  discuss  its  efficiency  in  terms  of  bounds  on  the  number 
of  major  iterations  for  general  problems.  The  specific  case  of  simple  recourse  problems  is  discussed  in  Section 
5.  Section  6  presents  results  of  numerical  experiments  and  the  appendices  provide  illustrative  examples  of 


2.  The  L -shaped  algorithm 


The  classical  two-stage  stochastic  linear  program  with  fixed  recourse  is  the  problem  of  finding 

min  z  =  ex  -fE$[ming(w)y(w)] 

s.t.  Ax  =  b 

T(ui)x  +Wy(w)  =  h(oj) 

x  >  0  y(w)  >  0  a.s.  (1) 


where  c  is  a  known  vector  in  R*1,  b  a  known  vector  in  Sm‘  ,  £  is  a  random  .Af -vector  defined  on  the 
probability  space,  (0,  S,  P),  and  A  and  W  are  known  matrices  of  sises  mi  x  ni  and  mj  x  n2,  respectively. 
W  is  called  the  recount  matrix. 

For  each  n>,  T(w)  is  m3  x  m,  q(u)  £  Rn>  and  h(w)  £  31  .  Piecing  together  the  stochastic  components 
of  the  problem,  we  obtain  a  vector  £(w)  =  (<j(w),h(w),7\(w),...,Tm, (w))  with  N  =  ny  4-  m3  +  (n2  x  «i) 
components,  where  Ti[u)  is  the  itk  row  of  T(u>).  Transposes  have  been  eliminated  for  simplicity.  E{ 
represents  the  mathematical  expectation  with  respect  to  (. 


A  precise  formulation  of  (1)  is  given  by  the  deterministic  equivalent  program  (D.E.P.): 

min  z  =  cx  +  fi(x) 

s.t.  Ax  =  b 

x  >0, 


(2) 


where 

c(x)  =  E<(?(*,eH), 

and 


=  min {g(w)y(w)  |  Wy(w)  =  h(w)  -  T(u)x,y>  0}. 

Properties  of  the  D.E.P.  have  been  extensively  studied  (Wets  (13),  Garstka  and  Wets  (6)).  Of  particular 
interest  for  computational  aspects  is  the  fact  that  Q(x,  £)  is  a  convex  piecewise  linear  function  of  z  and  that 
Q(x)  is  also  piecewise  linear  convex  if  (  has  finite  support. 
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I. 


When  T  is  non-stochastic,  the  original  formulation  (2)  can  be  replaced  by 


min  z  —  cx 

+*(x) 

s.t.  Ax 

=  6 

Tx 

-x  =o 

X 

>  0 

(3) 

where  ¥(*)  =  EfV’U.  £(“»))  Hx,Uu))  =  min{g(w)y(w)  |  Wy(w)  =  h(w)  -  x>  y  >  0}.  This  formulation 
stresses  the  fact  that  choosing  x  corresponds  to  generating  an  m? -dimensional  tender  x  =  Tx  to  be  “bid” 
against  the  outcomes  h(u)  of  the  random  events. 

In  this  paper,  we  concentrate  on  algorithms  for  solving  (2)  or  (3).  Excluding  algorithms  for  the  specific 
simple  recourse  problem  (see,  e.g.,  Kail  [8],  Wets  (14)),  a  major  method  for  solving  (2)  is  the  L-shaped 
algorithm  due  to  Van  Slyke  and  Wets  (12)  which  is  an  outer  linearisation  procedure  as  in  Benders’  decom¬ 
position  (Benders  (l|).  For  more  details  on  other  algorithmic  procedures,  see  the  discussion  in  Wets  [14]. 
Outer  linearisation  is  generally  preferred  to  inner  linearisation  of  the  dual  because  the  dual  generally  has 
more  rows  than  the  primal  and,  hence,  requires  more  work  per  iteration.  Outer  linearisation  is  also  generally 
preferred  to  basis  factorisation  in  stochastic  linear  programming  because  basis  requires  storing  a  basis  for 
each  realisation  of  (.  In  outer  linearisation,  these  bases  need  not  be  stored.  Efficient  procedures  (see  Wets 
(14))  may  then  be  used  to  solve  Q(x,  £(w))  for  large  numbers  of  realisations  of  £. 

The  L-shaped  method  consists  of  solving  an  approximation  of  (2)  by  using  an  outer  linearization  of  Q. 
Two  types  of  constraints  are  sequentially  added:  (i)  feasibility  cuts  (5)  determining  (x|  ^(a:)  <  -foo}  and  (ii) 
optimality  cuts  (6)  which  are  linear  approximations  to  Q  on  its  domain  of  finiteness. 

Assumption:  The  random  variable  £  has  finite  support. 

Let  k  =  1, ...,  K  index  the  possible  realisations  of  £  with  probabilities  p*. 

L-shaped  algorithm 

Step  0.  Set  a  =  t  =  v  =  0. 

Step  1.  Set  i>  =  v  +  I.  Solve  the  linear  program  (4)  -  (6). 


min  z  =  cx 


+6 


(4) 


S.t. 

Ax 

=  b 

Dix 

>  dltl=  1.....S 

(5) 

Etx 

+8 

>e,,i  = 

(6) 

x  >  0, 

6  €». 

Let  (i?X)  t* 

an  optimal  solution.  If  no  constraint  (6)  is  present,  8  is  set  equal  to 

—oo  and  is  ignored 

in  the  computation. 

Step  2.  For  k  =  1, ... 

min 

.,  K  solve  the  linear  program 

w1  =  ev+ 

+eu~ 

s.t. 

Wy 

+Iv+ 

-Iv~ 

=  hk  -  Tkxv 

y  >  0, 

t>+  >  o, 

<2 

IV 

© 

where  e  =  (1 . 1),  until,  for  some  k,  the  optimal  value  to1  >  0.  Let  a”  be  the  associated  simplex  multipliers 

and  define 

D.+ 1  =  ovTk 


and 


d,+  i  —  a*  hk 


to  generate  a  feasibility  cut  of  type  (5).  Set  s  =  s  +  1  and  return  to  Step  1.  If,  for  all  k,  w1  =  0,  go  to  Step 
3. 


Step  S.  For  k  =  1, K  solve  the  linear  program 


s.t. 


Wy 

y 


=  hk-  Tkxv 

>  0. 


m 


Let  *£  be  the  simplex  multipliers  associated  with  the  optimal  solution  of  Problem  k  of  type  (7).  Define 

K 

£«+i  =  ^,Pk*kTk  (8) 


k=l 
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and 


K 

et+i='%lPk*khk-  (9) 

fc=i 

Let  w2u  =  et+i  -  Et+ ii*\  If  6V  >  v?u ,  stop,  X"  is  an  optimal  solution.  Otherwise,  set  t  =  t  +  1,  and 
return  to  Step  1. 

Improvements  in  this  algorithm  have  been  given  in  two  directions:  (i)  the  study  of  cases  in  which  Step 
2  can  be  modified  to  solve  only  one  linear  program  instead  of  N  and  (ii)  the  study  of  bunching  and  sifting 
procedures  to  reduce  the  work  in  Step  3  (Garstka  and  Rutenberg  [5]).  We  again  refer  to  Wets  [14]  for  a 
detailed  account  of  these  improvements. 

In  this  paper,  we  propose  to  replace  the  outer  linearisation  of  Q  used  in  the  L-shaped  method  by  an 
outer  linearisation  of  all  functions 

Qfc(x)  =  min{?*y  |  Wy  =  hk  -  Tkx,  y  >  0},  (10) 

of  which  Q{x)  constitutes  the  expectation,  i.e.  Q(x)  =  52*Li  PkQk(*)- 

3.  The  Multicut  L-shaped  Algorithm 

The  multicut  L-shaped  algorithm  is  defined  as  follows: 

Step  0.  Set  a  =  v  =  0  and  tk  =  0  for  all  k  =  1, . . . ,  K. 

Step  1.  Set  i/  =  v  +  1.  Solve  the  linear  program  (11)  -  (13). 


min  z  = 

CX+ 

Y.LvOk 

(11) 

8.  t. 

Ax 

=  b 

Dix 

>  dhl  =  l,...,3 

(12) 

Ei(k)X 

+9k 

^  eHk)J(k)  =  1  ,...,t(k),k=  1,.. 

,K, 

(13) 

X 

>0, 

Let  (xW, ...,  $k)  be  an  optimal  solution  of  (11).  If  no  constraint  (13)  is  present  for  some  k ,  9 %  is  set 
equal  to  —  oo  and  is  ignored  in  the  computation. 
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Step  t.  As  before. 

Step  S.  For  fc  =  1, ...,  K  solve  the  linear  program  (7). 

Let  *r£  be  the  simplex  multipliers  associated  with  the  optimal  solution  of  problem  k.  If 

K  <  Pk*Z(hk  -  Tkxu)  (14) 

define 

£«(*)  + 1  =  Pk*kTk  (15) 

and 

««(fc)  +  l  =  PkK^k  (16) 

and  set  t(Jfc)  =  t(Jfc)  +  1. 

If  (14)  does  not  hold  for  any  J fc  =  1  ,...,K,  stop,  X?  is  an  optimal  solution.  Otherwise,  return  to  Step  1. 

We  illustrate  the  differences  and  similarities  between  the  multicut  approach  and  the  standard  L-shaped 
algorithm  in  the  example  of  Appendix  A.  The  multicut  approach  is  based  on  the  idea  that  using  outer 
approximations  of  all  Qk(x)  sends  more  information  than  a  single  cut  on  Q(x)  and  that,  therefore,  fewer 
iterations  are  needed. 


4.  Efficiency  and  bounds 


The  following  dominance  property  can  be  established.  Define  K i  n  Ki  to  be  the  constraint  set  of  the 
stochastic  program  (2),  where 


K i  =  {x|  Ax  =  b,  x  >  0} 


and 

/f2  =  Djgo (x  |  3y  >  0  such  that  Wy  =  h(£)  —  r(£)x}, 


where  by  assumption  5  is  finite. 


Q(x)  is  known  to  be  piecewise  linear,  hence  there  exists  a  polyhedral  decomposition  of  Ki  n  K?  into  a 
finite  collection  of  closed  convex  sets  Cr,  called  the  cells  of  the  decomposition,  such  that  the  intersection  of 
two  distinct  cells  has  an  empty  interior  and  such  that  the  function  £(z)  is  either  identically  -oo  or  affine 
on  each  cell. 

The  L-shaped  method  outerlinearises  Q(x)  by  identifying  a  facet,  the  function  graph  for  one  cell  of  the 
decomposition,  on  each  return  to  Step  1.  The  multicut  algorithm  outerlinearises  Q*(z).  On  each  return  to 
Step  1,  the  multicut  algorithm  identifies  a  facet  of  some  Q*(z).  This  information  may,  however,  be  equivalent 
to  identifying  several  facets  of  Q  since  each  combination  of  facets  of  Q*  corresponds  to  a  single  facet  of  Q. 
This  property  enables  the  multicut  algorithm  to  converge  faster  than  the  L-shaped  algorithm. 

In  the  following  proposition,  we  state  this  more  precisely.  We  define  a  major  iteration  to  be  the  operations 
performed  between  returns  to  Step  1  in  both  algorithms.  Simplex  iterations  are  the  number  of  simplex 
algorithm  pivots  performed  on  any  of  the  linear  programs  considered  by  the  algorithms. 

Proposition:  Let  {z"}  be  a  sequence  of  points  generated  by  the  multicut  algorithm  and  let  {y"}  be  a 
sequence  generated  by  the  L-shaped  algorithm.  Then,  if  at  all  major  iterations,  xu  and  y"  belong  to  the 
same  cells  of  the  decomposition  of  Q,  the  number  of  major  iterations  needed  by  the  multicut  algorithm  will 
be  less  than  or  equal  to  the  number  of  major  iterations  of  the  L-shaped  algorithm. 

Proof.  If  the  conditions  of  the  propostion  are  met,  then  constraints  (5)  and  (12)  are  the  same  in  the  L- 
shaped  and  multicut  algorithms.  Each  constraint  in  (6)  corresponds  to  K  constraints  in  (13)  such  that  £j  = 
!£fc=i  EHk)  and  et  =  ei(fc).  Hence,  if  (z,  0k),fc  =  are  feasible  in  (11)  -  (13)  for  ifc  =  1, . . . ,  K, 

then  (x,9  =  #*)  is  feasible  in  (4)-(6).  Therefore,  the  multicut  algorithm  objective  value,  z(multi)  > 

z(L-shaped),  the  L-shaped  algorithm  objective  value.  If  r(L-shaped)  =  z‘ ,  the  optimal  value  in  (1),  then 
z(multi)  =  z*.i 


Note  that  zv  and  \f  belong  to  the  same  cell  of  the  Note  that  xv  and  y"  belong  to  the  same  cell  of  the 


decomposition  if  the  recourse  function  <?(z,£)  is  linear  in  £  for  each  iterate  z.  Whenever  a  nonlinearity  is 


detected,  however,  the  iterates  generally  diverge.  In  addition,  whether  the  iterate  points  belong  to  cells  that 
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are  close  to  or  far  from  the  optimal  point  is  partly  a  matter  of  chance.  Therefore,  the  L-shaped  method  can 
conceivably  do  better  than  the  multicut  approach  (the  reverse  is  obviously  also  true)  in  terms  of  number 
of  major  iterations.  We  illustrate  this  by  the  example  in  Appendix  B.  Other  examples  where  the  multicut 
approach  does  better  than  the  L-shaped  method  can  easily  be  constructed  (see  Appendix  A). 

Since  none  of  the  methods  is  superior  to  the  other  in  all  circumstances,  the  efficiency  of  the  two  ap¬ 
proaches  is  measured  in  terms  of  worst-case  analysis  on  the  number  of  major  iterations. 

Definition: 

Let  6(£)  represent  the  maximum  number  of  different  slopes  of  Q(x,  £)  in  any  direction  parallel 
to  one  of  the  axes  for  a  given  £  ,  i.e.  the  maximum  number  of  different  cells  (of  the  polyhedral 
decomposition  of  K\  n  K?  relative  to  Q(x,  £)  for  a  given  £)  encountered  by  any  ray  (parallel  to  one 
of  the  axes)  originating  at  a  point  arbitrarily  chosen  in  Ki  n  K 3. 

Define  b  =  max{€e6(£)  to  be  the  “slope  number  of  the  second-stage  of  (2).” 

For  examples  of  6(£)  and  6,  see  the  appendices.  Figure  1  illustrates  the  example  in  Appendix  A.  The 
functions  Qlf  Q3,  and  Q3  represent  Q(x,{)  for  £*  =  1,  £*  =  2,  and  £3  =  4,  respectively.  In  this  case, 
m2  =  1,  6(1)  =  6(2)  =  6(4)  =  6  =  2.  In  Appendix  B,  m2  =  1,  6(£1)  =  2,  and  6(£2)  =4  =  6. 

Theorem:  Let  6  be  the  slope  number  of  the  second  stage  of  (2).  Then,  the  maximum  number  of  iterations 
for  the  multicut  algorithm  is 

1  +  K (6m>  -  1)  (17) 

while  the  maximum  number  of  iterations  for  the  L-shaped  algorithm  is 

(1  +  K(b-  l)]m>  (18) 

where  K  is  the  number  of  different  realisations  of  £. 

Proof:  To  illustrate  the  result,  consider  Figure  1  for  the  example  in  Appendix  A.  Let  6  be  the  slope  number 
of  the  second  stage  of  (2)  (6  =  2  in  Figure  1).  In  the  worst-case  (as  in  Figure  1),  6(£)  =  6  for  all  £  £  5. 
A  single  linear  piece  of  each  Qk,  k  =  in  some  direction  j  corresponds  to  a  single  linear  piece  of  Q 
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in  direction  j.  Each  new  slope  for  each  Qi  can  result  in  a  new  slope  for  Q  in  direction  j.  For  6-1  new 
slopes  for  each  qi,  in  the  worst-case,  Q  obtains  1  +  K(b  -  1)  slopes  in  direction  j.  (Note  the  4=1+  3(1) 
slopes  in  Figure  1.)  Since  this  can  occur  in  each  direction  j  =  1, . . . ,  mj,  [1  +  K(b  -  l))mj  facets  of  Q  can 
be  generated. 

In  the  worst-case,  the  L-shaped  method  considers  every  facet  of  Q  (proving  (18)).  For  the  multicut 
approach,  however,  in  the  worst-case,  one  facet  of  each  Q *,  is  identified  in  each  step.  Since  each  Qk  has  at 
most  6  slopes  in  direction  j,  each  Qk  has  at  most  6mi  facets.  On  the  first  iteration,  a  facet  is  identified  for 
each  £*,  k  =  1, . . . ,  K.  Hence,  the  maximum  number  of  iterations  is  1  +  (Kbmi  —  K),  proving  (17). ■ 

The  maximal  number  of  iterations  has  an  immediate  consequence  on  the  size  of  the  first-stage  problems 
to  be  solved.  While  problems  of  smaller  size  are  needed  in  the  first  iterations  of  the  L-shaped  method 
(mi  +  1  constraints,  r»i  +  1  variables)  as  compared  to  the  multicut  (mi  +  K  constraints,  nx  +  K  variables), 
the  above  theorem  shows  that  the  size  of  the  problem  is  of  the  order  (6  —  in  the  worst-case  for 

the  L-ahaped  approach  and  K(bmi  —  l)  for  the  multicut  strategy.  One  can  therefore  expect  the  multicut 
approach  to  be  especially  efficient  for  problems  where  mj  is  large,  many  cuts  are  needed,  and,  as  we  mention 
in  the  discussion  of  numerical  examples  below,  K  is  not  larger  than  »i. 

In  the  next  section,  the  number  of  facets  for  the  particular  case  of  simple  recourse  is  given  explicitly. 

5.  The  Simple  Recourse  Case 

The  simple  recourse  problem  is  a  particular  case  of  the  formulation  (3)  with  non-stochastic  matrix  T 
where  the  function  ^(x>£)  is  separable 

mt 

*(x,0  =  5>i(x<.&)  (19) 

t=l 

and 

MXi,  fr)  =  min {q? y?  +  q~  y~  j  y,+  -  y~  =  hi  -  Xi,  y,+  >  0,  y~  >  0},  (20) 

where 

=  (<7i+  >?,“  A)- 
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Assume  that,  for  each  t,  &  can  take  on  J  different  values  (where  for  simplicity  of  exposition  J  is  assumed 
to  be  the  same  for  all  »). 

Then,  using  the  multicut  approach  consists  of  approximating  the  recourse  function  'P(x)  by  the  outer- 


linearisation 


mj  J 

££*./•  (21) 

«=i ;=i 

Due  to  the  simple  recourse  property,  only  two  cuts  of  type  (13)  can  be  generated  for  each  0<y,  namely 


.  -  M 


9 a  >  -  Xi) 


where  p^y  denotes  the  probability  of  the  j*h  realisation  of 
Introducing  the  slack  variable  u<y  in  constraint  (22), 


i  ~  Kj)  +  «*t y  =  9i) 


and  substituting  0<y  from  (24)  into  (21)— (23) ,  the  simple  recourse  problem  (19),  (20)  is  equivalent  to 


«  +  ESi  e/-i  Hituxi  -  w  +  et=\  e;=i 


mj  J 


s.t.  Ax 


>  PiwAki  -  x»). 

*  =  1,...,  n^, ;  =  1, ....  J 


>  0,*  =  l,...,m3,j  =  1 J, 


where  ql}  =  +  9i>. 

From  (25),  we  can  derive  the  following  algorithm. 


Multicut  Algorithm  for  Simple  Recourse  Problems 


Step  0.  Set  v  =  t  =  0. 

Step  1.  Set  v  =  v  +  1.  Solve  the  linear  program 


min 

CX 

+  E,m=1E/=iP.w-(7,lx) 

+  E‘=iu< 

8.t. 

Ax 

=  b 

«*1 

>  ej  —  EiX,  1=1 

>0,1=  1 . t. 

Let  (z*'l  «*')  be  an  optimal  solution.  If  t  =  0,  then  u  is  ignored  in  the  computation. 
Step  £.  For  each  t  =  1, . . . ,  mj,  and  j  =  1, . . . ,  J,  if  the  constraint 


is  violated,  define 


and 


and  set  t  =  t  +  1. 


o  >  paqiAk  j  ~  r*1") 


Et  +  l  —  PijqijTi 


*<+i  —  Pu9«Ay 


(27) 


Note  that  the  constraints  in  (26)  are  a  subset  of  the  constraints  in  (25).  We  use  the  notation  u<  to 
represent  those  in  (25)  that  have  been  identified  in  Step  2  of  the  multicut  algorithm.  Inequality  27 
identifies  any  constraints  in  (25)  that  are  not  met  on  iteration  u.  These  constraints  are  added  for  the  next 
iteration,  v  +  1. 

The  initial  problem  (27)  involves  mj  constraints  and  rii  variables.  For  this  problem,  the  worst-case 
situation  is  when  at  each  iteration,  only  one  constraint  (27)  is  violated  in  Step  2.  Then,  the  maximal 
number  of  iterations  is  Jmj  +  1.  To  compare  with  the  maximal  number  of  iterations  an  L-shaped  algorithm 
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would  require  to  solve  the  same  problem,  note  that  for  each  t,  the  function  *<(*»)  =  E lMx<,  &)  contains 
J  +  l  facets  and  since  ¥(*)  is  separable  in  t,  it  contains  at  most  (J  +  l)m>  facets.  This  is  precisely  the 
worst-case  upper  bound  on  the  number  of  iterations  for  an  L— shaped  type  algorithm  as  in  the  theorem  of 
Section  4. 

6.  Numerical  Experimentation  and  Conclusions 

The  L— shaped  algorithm  and  the  multicut  method  have  been  coded  in  FORTRAN  in  the  codes  NDREG 
and  NDSEP  respectively.  NDREG  is  a  two-stage  version  of  the  multi-stage  code  developed  by  Birge  in  [3] 
and  described  in  [4].  NDSEP  uses  the  same  subroutines  for  linear  program  solutions,  constraint  generation 
and  constraint  elimination  as  NDREG.  The  subroutines  to  control  where  cuts  are  placed  and  to  determine 
optimality  have  been  modified  in  NDSEP  to  reflect  the  differences  between  the  standard  L— shaped  method 
and  the  multicut  approach. 

The  set  of  test  problems  and  their  sise  characteristics  appear  in  Table  1.  The  first  four  problems  are 
small  energy  examples  with  varying  objectives  and  constraints  and  the  last  example  is  a  stochastic  two- 
stage  version  of  one  of  Ho  and  Loute’s  [7]  staircase  problems.  These  examples  were  chosen  because  of  their 
applicability  and  the  facet  structure  of  their  recourse  functions. 

The  problems  were  solved  using  the  FORTRAN-G  compiler  at  The  University  of  Michigan  on  an  Amdahl 
5860.  The  number  of  major  iterations,  simplex  iterations  and  CPU  seconds  are  given  for  each  problem  in 
Table  2,  where  "Single  Cut"  refers  to  NDREG  and  “Multiple  Cuts”  refers  to  NDSEP.  Both  NDREG  and 
NDSEP  used  the  bunching  approach  (Wets  [14])  for  solving  second-period  problems.  They  also  both  included 
the  deletion  of  slack  cuts  which  resulted  in  savings  of  up  to  twenty  percent  in  CPU  times. 

The  results  in  Table  2  illustrate  the  effectiveness  of  the  multicut  approach  and  some  of  its  shortcomings. 
In  each  example,  the  number  of  major  iterations  is  reduced.  This  is  due  to  the  passing  of  more  information 
on  each  major  iteration  as  noted  above.  A  difficulty  arises,  however,  because  of  the  increased  size  of  (11)  - 
(13)  over  (4)  -  (6).  Although  (4)  -  (6)  in  the  worst-case  may  have  many  more  constraints  than  (11)  -  (13), 
program  (11)  -  (13)  is  initially  larger  and,  hence,  requires  more  time  to  solve.  This  leads  to  the  increased 
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time  in  solving  NRG4  by  NDSEP.  NDSEP,  in  fact,  spends  2.8  more  CPUs  solving  (11)  -  (13)  than  NDREG 
spends  solving  (4)  -  (6)  on  NRG4.  This  problem  is  an  especially  bad  case  because  the  original  problem  is  so 
small  that  the  addition  of  27  extra  constraints  increases  its  sise  nine-fold  and  has  a  significant  slowing  effect. 

These  examples  suggest  that  the  multicut  approach  can  lead  to  significant  reductions  in  the  number 
of  major  iterations.  As  indicated  above,  the  worst-case  advantage  of  the  multicut  approach  in  limiting 
major  iterations  is  enhanced  as  mj  increases  in  sise.  The  experiments  show  that  the  multicut  approach 
is  most  effective  when  the  number  of  realisations  K  is  not  significantly  larger  than  the  number  of  first 
period  constraints  r»i.  When  K  is  large  relative  to  rii,  it  may  be  advantageous  to  use  a  hybrid  approach 
in  which  subsets  of  the  realisations  are  grouped  together  to  form  a  reduced  number  of  combination  cuts. 
The  worth  of  this  and  other  strategies  is,  however,  problem  dependent  and  should  be  demonstrated  through 
experimentation  in  different  and  varied  application  areas. 


Table  1.  Problem  parameters 


Problem 

Period  1 

(A) 

Period  2  (W) 

Realizations 

m1 

P* 

nj 

ma 

P* 

K 

NRGl 

7 

3 

1.000 

20 

8 

0.375 

3 

NRG2 

7 

3 

1.000 

20 

8 

0.375 

3 

NRG3 

7 

3 

1.000 

20 

8 

0.375 

9 

NRG4 

7 

3 

1.000 

20 

8 

0.375 

27 

SCAGR7.S2 

30 

16 

0.191 

79 

39 

0.092 

8 

‘fraction  of  elements  (excluding  slack  variable  elements)  which  are  nonsero 

Table  2.  Experimental  results 


Problem 

Single  Cut 

Multiple  Cuts 

Major 

Simplex 

CPUs 

Major 

Simplex 

CPUs 

Iterations 

Iterations 

Iterations 

Iterations 

NRGl 

10 

117 

0.34 

6 

64 

0.23 

NRG2 

13 

163 

0.49 

9 

92 

0.35 

NRG3 

14 

196 

1.26 

8 

121 

1.11 

NRG4 

14 

207 

3.19 

7 

166 

5.66 

SCAGR7.S2 

10 

138 

1.06 

7 

108 

1.40 

Appendix  A 

Assume  that  ni  =  1,  i»a  =  2,  mj  =  1,  K  =  3,  W  —  (1  —  l),  and  Q(x,  £)  —  {£  —  *,  if  x  <  £;  x  —  (,  if 
x  >  £},  and  that  (  can  take  on  the  values  1,  2,  and  4,  each  with  probability  1/3.  Assume  also  cx  =  0  and 
0  <  x  <  10.  Note  that  Q  has  two  slopes  for  each  £,  hence,  b  =  2. 

Figure  1  represents  the  functions  <?i(z),  <Ja(x),  <?3(z),  and  fi(x).  Since  the  first-stage  objective  cx  is 
sero,  Q(x)  is  also  the  function  *(x)  to  be  minimised.  Assume  the  starting  point  is  x1  =  0.  The  sequence  of 
iterations  for  the  L-shaped  method  would  be: 

Iteration  1: 


x1  is  not  optimal;  send  the  cut 


Iteration  2: 


x 2  =  10, 03  =  —23/3  is  not  optimal;  send  the  cut 

9>x-  7/3. 

0  is  not  optimal;  send  the  cut 


Iteration  4‘- 
x*  =  1.5,  9* 

Iteration  5: 

x 6  =  2,  06  =  1,  which  is  the  optimal  solution. 

Starting  from  x1  =  0,  the  multicut  approach  would  yield  the  following  sequences: 

Iteration  1:  x1  is  not  optimal;  send  the  cuts  0!  >  >  !=■*,  03  > 

Iteration  2:  x3  =  10,  93  =  —2,  9\  =  —8/3,  0§  =  — 3  is  not  optimal; 
send  the  cuts  >  *=*,  $3  >  tzi. 

Iteration  3:  x 3  =  2,  03  =  2/3,  9 2  =  0,  03  =  1/3  is  the  optimal  solution. 

Therefore,  by  sending  separate  cuts  on  Qi(x),  Q2{x),  and  Q3(x),  the  full  description  of  Q(x)  U  obtained 


Iteration  3: 
x3  =  7/3,  03  = 


in  two  iterations. 


Appendix  B 


!— 1.5*  if  *  <  0, 

0  if  0  <  x  <  2, 

2/7(*  -  2)  if  2  <  *  <  9, 

*  —  7  if  *  >  9. 

Assume  also  that  *  is  bounded  by  -20  <  *  <  20  and  c  =  0.  Starting  from  any  initial  point  *l  <  -1, 
one  obtains  the  following  sequence  of  iterate  points  and  cuts  for  the  L-shaped  method.  Note  that  four  slopes 
occur  for  Qi  ,  hence,  6  =  4. 


Iteration  1:  x1  =  —2,  81  is  omitted;  new  cut  8  >  —0.5  —  1.25*. 


Iteration  8:  x3  =  +20,  8 3  =  —25.5;  new  cut  9  >  0.5*  —  3.5. 

Iteration  S:  x3  =  12/7,  83  =  —37/14;  new  cut  8  >  0. 

Iteration  4:  x*  €  [—2/5,7],  8 *  =  0. 

If  x*  is  chosen  to  be  any  value  in  [0,2]  then  the  algorithm  terminates  at  Iteration  4. 


The  multicut  approach  would  generate  the  following  sequence. 

Iteration  1:  x1  =  —2,  8 J  and  8 £  omitted;  new  cuts  &i  >  —0.5*  —  0.5,  8j  >  —3/4*. 

Iteration  8:  x3  =  20,  8 3  =  —10.5,  8\  =  —15;  new  cuts  9\  >  0,  9?  >  0.5*  —  3.5. 

Iteration  S:  *3  =  2.8,  8 3  =  0,  fl3  =  —2.1;  new  cut  8i  >  2/7  (*  —  2). 

Iteration  4-'  *4  =  0.552,  9*  =  0,  6\  =  —0.414;  new  cut  82  >  0. 

Iteration  5:  *5  =  0 ,  8\  =  d\  =  0,  STOP. 
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